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© Apparatus for generating edge position signals for use in locating an address element on a 
mailpiece. 

© The edges of address elements such as address labels and window apertures located on a mailpiece, are 
detected by utilizing illumination from first and second alternating "on" and "off" light sources which illuminate 
the address elements at an acute angle. In the case of label detection, the edge closest to the on illuminating 
source generates a high contrast image, while the edge furthest from the "on" illuminating source is shadowed. 
In the case of illumination of an aperture, the opposite is true. That is, the light reflected from the edge which is 
furthest from illuminating source is high contrast while edge closest to the illuminating source has a lower 



^contrast. When the images generated due to edge illumination by the left and right tight sources are subtracted 
Ofrom each other, the edges are further enhanced due to the fact that the remaining portions of the images cancel 
29 each other out. 
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APPARATUS FOR GENERATING EDGE POSITION SIGNALS FOR USE IN LOCATING AN ADDRESS 

ELEMENT ON A MAILPIECE 



TECHNICAL FIELD 



s The present invention pertains to apparatus and methods for generating signals which represent edge 
positions of address labels and apertures on an envelope for use in determining the locations of the labels 
and apertures for optical character reading. 

10 DISCLOSURE OF THE INVENTION 



For a number of years, optical character readers have been used at post offices to automatically read 
addresses containing city, state and zip code information. This address information is utilized to automati- 

75 cally sort incoming mail for delivery by mail carriers. However, since the position of the address on the 
envelope, as well as the size of the envelope may vary, it is necessary to first locate the address on each 
envelope before it can be optically read. 

Presently, a significant number of the mailpieces utilize either address labels which are attached to the 
surfaces of the envelopes, or transparent windows through which the addresses are displayed. 

20 In the present invention, signals are generated which represent the positions of the edges of labels and 
apertures for their use in locating the position of the address information on the maiipiece. 

Conventionally, a number of detection systems have been disclosed. For example, in Maxey U.S. 
Patent No. 3,890,509 there is disclosed apparatus for detecting the edges of a sawn board by means of 
light directed at a low angle of incidence to the board, whereby the intensity of sensed light reflected from 

25 the board varies as a function of the locations of the board edges. Furthermore, Henderson, in U.S. 
4,011,447 discloses a device for detecting the presence of a leading edge and trailing edge of a passing 
object, and whereby the passing object interrupts a predetermined portion of a light beam and causes a 
detector/amplifier to signal the presence of the object. 

Other detecting devices include U.S. 3,932,755 by Sagawa which pertains to an apparatus for detecting 

30 sheets of paper in a pile for paper-feeding purposes whereby when there is only one sheet of paper in the 
pile, a light beam passes through the single sheet and is reflected at different levels from a high-level 
reflecting plate and low-level reflecting plate supporting the sheet. 

In addition, Nakozawa et al. in U.S. 4,112,309 discloses apparatus for detecting the falls of an IC chip in 
which a laser beam is directed onto the surface of this moving chip and whereby the light is diffracted at 

35 the falls to be detected by photosensing means. 

The present invention pertains to apparatus and methods for generating a signal representing an edge 
of an address element, such as a raised label or a depressed aperture, which is located on a piece of mail. 
The edge position signals may be used for locating the position of the address element on the maiipiece for 
scanning by an optical character reader. The method includes the steps of providing the address element 

4o which is located adjacent to a first horizontal surface of the maiipiece and which has a second horizontal 
surface as well as a vertical surface located between the first horizontal surface and the second horizontal 
surface in a manner to form the edge. The method further includes the steps of directing an illuminative 
output toward the maiipiece and address element at an acute angle to the first and second horizontal 
surfaces. Furthermore, there is included the step of detecting light which is reflected from the address 

45 element and maiipiece in a manner that light reflected from the first and second horizontal surfaces 
generates first and second luminance signals of substantially equal levels, and light reflected from the 
vertical surface generates a third luminance signal having a level which is different than the levels of the 
first and second signals. An additional step includes generating first and second output signals of 
substantially equal levels in response to the first and second luminance signals in a manner that the first 

so and second output signals are associated with the locations of the first and second horizontal surfaces. In 
addition, there is generated a third output signal, having a level which is different than the levels of the first 
and second output signals, in response to the third luminance signal, and which is associated with the 
location of the vertical surface between the first and second horizontal surfaces. 

It is therefore an object of the present invention to provide a system for generating a signal which 
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represents the location of an address element edge on a mailpiece. 



BRIEF DESCRIPTION OF THE DRAWINGS 

5 

These and other objects and advantages of the present invention will become more readily apparent 
upon reading the following detailed description in conjunction with the attached drawings, in which: 

Fig. 1 is a schemmatical block diagram overview of the label/aperture detection system for 
70 generating edge position signals; 

Fig. 2 shows light rays SiT t S2T and S N T illuminating a point T on a plane P; 

Fig. 3 is a simplified diagram of a label located on a planar envelope surface in order to illustrate the 
effect on surface luminance of grazing light which illuminates the raised label; 

Figs. 4A and 4B are simplified diagrams showing how alternating light sources Si and S2 produce 
is bright edges and shadows at opposite edges of the label and mailpiece; 

Figs. 5A and 5B are simplified diagrams showing how alternating light sources, Si and S2, generate 
bright edges and shadows at opposite edges of an aperture and mailpiece; 

Figs. 6A and 6B are idealized output signals of surface luminous intensity as a function of scanner 
pixel location for one scan of an envelope with an attached label, and more specifically Fig. 6A shows the 
20 surface luminous intensity when the envelope is illuminated from a source to its left, and Fig. 6B shows the 
surface luminous intensity when the envelope is illuminated from a source to its right; 

Fig. 7 is an idealized graph of an image difference signal as a function of scanner pixel location 
which is generated when the signals in Figs. 6A and 6B are subtracted from each other; 

Fig. 8 is a flowchart showing the sequence of signal processing functions performed on the luminous 
25 intensity signals up to and including their subtraction; 

Fig. 9 is a visual image of the binarized difference data which is located below a picture of the 
corresponding mailpiece with attached label; and 

Figs. 10A t B and C are flowcharts showing the sequence of signal processing functions performed on 
the difference signals to locate the positions of the label and envelope edges. 

30 



MODES OF CARRYING OUT THE INVENTION 

35 

Briefly, the present invention utilizes incoherent illumination generated at an acute angle to highlight 
edges of an address label or address aperture (window) of an envelope. This permits the position of the 
label or aperture to be determined so the address may read automatically by an optical character reader or 
the like. 

40 As shown in Fig. 1, the principal elements of the present invention include a conveyor 10 for 
transporting mailpieces 12, having left, right parallel lengthwise extending edges 13a, 13b, and including 
thereon address labels 14 (or apertures), in a linear direction parallel to an axis shown by a line designated 
by the number 16. For purposes of the present invention, the term "label" is used to refer to a raised 
element which is attached to the surface of the mailpiece. On the other hand, the term "aperture" refers to 

45 a typically rectangular opening in the mailpiece through which an address printed on a page inside the 
mailpiece appears. Furthermore, the words "label" and "aperture" are identified genericaliy herein by the 
term "address element". 

During movement of the conveyor 10 by means of a conventional drive motor 18 and conventional drive 
electronics 19, the left, right parallel lengthwise extending edges 20a, 20b of the labels are illuminated by a 

so pair of strobe lamps 24, with the resulting image of the address element being focused by a conventional 
lens system 25 onto a conventional image sensor 26 which is located above the mailpiece and which scans 
in a linear direction normal to axis 16. Sensor 26 converts the incoming images to electrical signals which 
are processed and enhanced by a signal processor 28 for their later use, i.e., to determine the location of 
the address element on the mailpiece. 

55 In order to better understand the present invention, an analysis of the effect of lighting angle on edge 
brightness is presented. With reference to Fig. 2, three light sources, SI, S2, S N are shown illuminating an 
ideal diffuse (Lambertian) white surface P. For sources S1, S2 and S N of equal light intensity, the 
illumination Eg produced at an underlying point T on surface P by grazing light from source Si, for 
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example, is proportional to the cosine of an angle Q\ where d is an an^W^heasured between a ray SiT 
generated from source Si and a ray S N T which is generated normal to plane P from the light source S N . In 
other words, the illumination Eqi of point T by light source Si is found by the equation E$^ = Eo cos 0, 
where Eo is the illumination generated at point T by light source S N - 

5 It is further known that illumination E$ (candles per sq. ft.) = luminance x reflectance/*-. Neglecting 
reflectance losses, i.e.. reflectance is set equal to one, then E$ = ttL$, where L$ is the value of surface 
luminance. By substitution, L$ ~ (EoM cos 0. 

Therefore, denoting surface luminance of point T due to SiT and S N T as Li and L N respectively, we 
determine that Li = (EoM cos 6 and L N = Eo cos(0*)/ir = Eo/?r. 

10 Now. in order to formulate an expression for the label edge illumination as a function of the light angle 
0, reference is made to Fig. 3 which shows a magnified side view of the address element (label) 14 having 
a top horizontal surface 32 and vertical side surface 34 which intersects with top surface 32 at the edge 20. 
In this embodiment, the label is located on a mailpiece having a top horizontal surface 35 and left, right 
vertical sides 36a. 36b; the intersections of the side surfaces 36a. 36b with the top surface 35 forming the 

is left, right edges 13a, 13b. For the purpose of the present description, it should be appreciated that the 
terms "horizontal" and "vertical" are used to describe relative locations of the elements to each other rather 
than describing their positions in an absolute sense. 

At a point A on the top surface 32 of the label, its surface luminance is expressed by the equation L A = 
(EoM cos 9. where L A is the luminance of point A due to source S1. Furthermore, at a point B on the 

20 vertical side 34 which is also illuminated by light source Si t its surface luminance, L St is expressed by the 
equation L B = (EoM cos (90 - 0), where (90 - 0) is the angle of the light rays SiT illuminating point B. This 
angle d is measured from an imaginary line designated by the number 36 which is normal to vertical side 
34. Since the contrast (brightness) of edge 20 is a function of the ratio L&/L A , this ratio can be expressed by 
the equation Lb/L a = [(EoM cos (90 -0)]/[(EoM cos B] = tan 9. 

25 It is apparent, therefore, that there is a difference in surface luminance between i) the vertical side 34, 
and ii) the horizontal top surface 32 of the label and the horizontal surface 35 of the maitpiece as a result of 
light which is incident at an acute angle to these surfaces 32, 35; the luminance of the mailpiece surface 35 
being approximately equal to the luminance of label surface 32. It is furthermore apparent from knowledge 
of the tangent function that this contrast in surface luminance increases with increases in the angle 0 above 

30 45* . That is, the luminance of side 34 increase over that of horizontal surfaces 32, 35 with an increase in 
angle 9 when 0 is greater than 45*. It is this difference in surface luminance between the side surface 34 
and horizontal surfaces 32, 35 which is utilized in the present invention to locate the edge of the label. 

In order to detect the edges of the envelope and label, in the present embodiment shown in Fig. 4, two 
light sources, Si and S2, located outboard of the lengthwise extending edges 13 of the envelope, are 

35 utilized. In a preferred embodiment, the "on" periods of the lights Si and S2 are alternated, with the signals 
formed by the detected difference in luminance due to each alteration being subtracted from each other to 
generate an output signal which is representative of locations of the envelope edges and label edges. 

More specifically, utilizing alternating light sources, light from the left lamp S2 illuminates the left side 
36a and top- surface 35 of the envelope, as well as the left side 34a and top surface 32 of the label. This 

40 results in high level contrast signals being developed to distinguish edges 20a, 13a, in the manner 
.discussed previously with reference to Fig. 3. At the same time, source S2 creates a shadow, shown by 
dashed lines identified by the numbers 40b, beyond the opposite right label edge 20b and envelope edge 
1 3b, so that effectively almost no light is reflected from label right side 34b and envelope right side 36b. 
This results in much lower contrast signals being developed to distinguish label right edge 20b and 

45 envelope right edge 13b. In this embodiment, light sources Si and S2 are "on" for equal periods .of time 
during each alteration, with the resulting contrast image being detected by the imager 26. 

Alternating the lamps produces the opposite effect as shown in Fig. 4B. That is, when right lamp Si is 
"on" and the left lamp S2 is "off", the envelope side 36b and label side 34b closest to source Si are 
illuminated. However, shadows are generated beyond the opposite label-edge 20a and envelope edge 13a 

50 thereby effectively masking label left side 34a and envelope left side 36a. Thus, when source Si is "on", 
high level contrast signals are developed to distinguish right edges 20b, 13b, and lower level signals are 
generated to distinguish left edges 20a, 13a. When the contrast signals generated by illumination of the 
envelope and the label are stored in the memory of processor 28 and then subtracted from each other, the 
resulting difference image is one which has enhanced amplitude portions which correspond to the left, right 

55 edges of the envelope and label, while the remainder of the image cancels itself out. This will be explained 
in greater detail shortly. 

In the case when an aperture is illuminated, the results are slightly different. As shown in Fig. 5A, the 
aperture indicated at 42 includes a bottom surface 44, .which typically might be a paper inside the 
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mailpiece, and left, right sides 46a, 46b which upstand from the bottom surface 44 and which intersect with 
mailpiece top surface 35 to form left, right edges 48a, 48b. Thus, when the aperture 42 is illuminated by the 
right source Si f for example, the mailpiece right side 36b is illuminated and the maiipiece left side is 
shadowed. However, at the same time, the aperture left side 46a is illuminated and the aperture right side 

5 46b is shadowed as shown by the dashed line 40b'. Alternating the light sources so that Si is "off" and S2 
is "on", produces the opposite result as shown in Fig. SB. However, when the aperture edge contrast 
signals generated due to illumination from the left and right sources are subtracted from each other, only 
the portions of the signal corresponding to the edges are enhanced, with the remaining portions of the 
signal cancelling each other out. For reasons which will become clearer shortly, this was the case 

iq previously with reference to Figs. 4A and 4B when the label was illuminated. 

The generation of edge position signals is set forth in greater detail with reference to Figs. 6A and 6B. 
In Fig. 6A, there is shown a graph of contrast intensity as a function of imager pixel location due to the 
operation of left lamp S2 during a single scan of a label and envelope. On the other hand, in Fig. 6B, there 
is shown a graph of contrast intensity as a function of imager pixel location due to operation of right lamp 

75 Si . As can be seen in Figs. 6A and 6B, the contrast intensities of a majority of the fiat area of the envelope 
and label including envelope top surface 35, label top surface 32 and aperture bottom surface 44, remain 
essentially constant except for area of text, i.e., address information, which is indicated by signals Stext. 
S thxt in Figs. 6A and 6B. When illuminated by the left light S2, the label left edge 20a and envelope left 
edge 13a generate increased contrast intensity signals Slenv and S L lab (Fig. 6A) at pixel positions A and B. 

20 At the same time, the shadowed label right edge 20b and the shadowed envelope right 1 3b generate low 
intensity contrast signals S RLA b and Srenv at pixel positions C and D. On the other hand, when illuminated 
by the right light Si , label, envelope ricjht edges 20b, 13b, generate increased contrast intensity signals 
S'rlab and S' RENV at positions c' and D as shown in Fig. 6B, while the shadowed label left edge 20a and 
shadowed envelope left edge 13a generate much lower contrast intensity signals s'llab and s' RL ab at 

25 positions A and B . 

It should be noted that positions a\ B , C , and D of Fig. 6B represent a slight shift from positions A, B, 
C, and D of Fig. 6A due to movement of the envelope during the time the address element is illuminated 
from the left and right sources. However, since the amount of movement during this time is so slight, little 
error is introduced when the signals of Figs. 6A and 6B are subtracted. 
* 30 It should be appreciated that each pixel address may be generated in processor 28 by means of a line 
counter which generates a new count for each line scanned by the imager 26, as well as by a pixel counter 
which generates a new count for each pixel scanned. These pixel positions may be stored in a frame store 
and recalled later to provide the address locations of the edges. 

When the contrast intensity signals represented in the graphs in Figs. 6A and 6B are subtracted from 

35 each other and the absolute value of the signal is determined, a signal |AS| = |S2 - S1( shown graphically 
in Fig. 7 is generated. In this manner, the contrast intensity signals representing the positions of the label 
edges and envelope edges are enhanced, while the contrast intensity signals representing the remaining flat 
areas of the label and envelope, as well as text information, cancel each other out. For example, the high 
level signal s'renv (Fig. 6B), which represents the right edge of the envelope at position d' when illuminated 

40 by the right light source Si . is subtracted from the lower level signal Src NV , which represents the left edge 
of the envelope at position D when illuminated by the left light source S2. This generates an even greater 
enhanced difference signal. More specifically, further enhancement of the edge signals result due to the 
cancelling out of the text and non-edge related information. That is, prior to subtraction, the differences (Fig. 
6A) in amplitudes between the contrast signals representing the flat areas of the label/aperture and the 

45 upper extent of the edge signals may be represented by a distance AY. However, after subtraction, this 
difference in amplitudes between the flat areas and the upper limit of the edge signals is represented by the 
distance AZ in Fig. 7 which is greater than AY due to mutual cancellation of the flat areas. Thus, an 
improved signal for locating the edges is provided. 

Having provided an overview of the present invention, the details of its implementation now will be 

50 discussed. Scanning of the mail pieces is accomplished by the imager 26 which in an exemplary 
embodiment is a digital camera such as the Eikonix Model 78/99. This camera is a high resolution linear 
array digital camera with 2,048 photodiode elements which are located generally perpendicular to axis 1 6. 
In this embodiment, the mailpiece is stationary and the array is mechanically driven by means of a stepper 
motor (not shown) in a. direction parallel to axis 16 to acquire image plane information in two dimensions. 

55 Each element returns a signal intensity which is digitized into 12 bits. In this embodiment, a field is divided 
into 2,048 lines with each mailpiece being scanned twice; that is, once when illuminated from the left by 
source S2 and once -when illuminated from the right by source Si . Assuming that the velocity of each 
mailpiece along conveyor 10 is about one hundred inches per second, a resolution of at least two hundred 
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and fifty samples per inch is required. 

Illumination of the mail pieces is accomplished by the lamps 24 which are positioned above and at 
opposite sides of the convey or 10. In an exemplary embodiment, each lamp 24 is a 120V t 250W tungsten- 
halogen light bulb located in close proximity to a metal reflector. An optimum angle e of illumination is 
s selected to be between about 65* and 75*. and preferably about 70*. Illumination angles much greater 
than 75* provide increased intensity signals, however, this also can result in spurious signals in the event 
the mailpiece is creased or slightly bent. Assuming that the linear array imager samples at a rate of ten 
lines per inch, each source Si or S2 flashes for equal periods at a rate of about one thousand flashes per 
second. 

70 Referring now to the flowchart in Fig. 8, image signals from the image sensor generated due to 
illumination by the "left source S2 and right source Si are fed along separate channels to the signal 
processor 28. In this description, the left channel blocks are identified by numbers with an "a" suffix 
attached, and the right channel blocks are identified by numbers with a "b" suffix attached. In an exemplary 
embodiment the processor 28 includes a MicroVax II minicomputer manufactured by Digital Equipment 

75 Corp., which is interfaced with a CSPI Mini Map array processor to process the left and right channel data 
in separate files. Initially, luminous signals for each file of data from the imager 26 are put through a 
logarithmic look-up table at blocks 48 and converted to their logarithmic base ten equivalent This 
conversion increases the contrast of the image signals in the darker areas of the mailpiece, while lowering 
their contrast in the lighter areas of the mailpiece. This lessens the effect of shadows caused by folds, 

20 creases, etc. in the mailpieces. Further image enhancement is accomplished by encoding the image signals 
in a conventional manner in gray scale from 0 through 255 at blocks 50. 

Subsequently, each line is conventionally Fourier transformed in two dimensions at blocks 52, then 
filtered at blocks 54 to remove all low frequencies, i.e., signals typically related to false edges such as 
bends or creases, and then inverse Fourier transformed back at blocks 56. Image processing utilizing a 

25 Fourier transformation and subsequent filtering are discussed in Digital Image Processing , R. C. Gonzalez, 
1977, pp. 36-88; as well as Digital image Processing Techniques , M.P. 

Ekstrom, 1984, pp. 18-25, the contents of Digital Image Processing and Digital Image Processing 
Techniques being incorporated herein by reference. 

Upon conclusion of the aforementioned image signal preprocessing, the left and right luminous signals 

30 are subtracted as discussed previously at subtractor block 58. After th.e resulting difference signals are 
calculated, the absolute value of those difference signals are then determined to produce a measure of the 
difference in intensity levels. 

Further image processing of the difference signal is then accomplished in order to better separate the 
edge signal portions from any remaining noise and spurious signals such as those caused by shadows, 

35 creases or folds in the mailpiece, and to generate more accurate edge position information. More 
specifically in the present invention, prior to connected component encoding, the data is binarized so as to 
define all of the difference levels in terms of either a bright code or a dark code. Binarization in conjunction 
with connected component digital image processing is also described in Digital Imaging Processing 
Techniques at pages 274 to 279. Referring now to the flowchart beginning at Fig. 10A, a binarization 

40 intensity threshold of about 170 is selected at fiowblock 64; This threshold has been determined to 
adequately reflect the intensity difference that corresponds to an edge. Beginning with the difference 
intensity value representing the first pixel position of the first scan line, and proceeding through pixels one 
through n of each line one through m, a determination at decision block 66 is made whether these values 
exceed the selected threshold. Each eight bits of intensity data is then reassigned a new value. That is, all 

45 of those intensity signals which exceed the threshold are assigned a "bright" (such as binary one) common 
code value at fiowblock 68 in place of their intensity level data; whereas those intensity signals which do not 
exceed the threshold are assigned a common "dark" code (such as binary zero) at fiowblock 69. In this 
manner, all of the pixel positions are either represented by a bright code value or a dark code value. A 
visual representation of the binarized data positioned below the mailpiece 12 and label 14 is shown in Fig. 9 

50 where the black areas identified by the letter "B" correspond to label codes which exceed the binarization 
threshold, and the remaining white areas identified by the tetter "W" correspond to label codes which do 
hot exceed the binarization threshold. ** 

To better determine where the edges lie, boundary determination techniques such as the conventional 
procedure of connected component processing are utilized. Connected component encoding is also 

55 discussed in Digital Image Processing at pages 347-348. In this manner, contiguous points (binarized data) 
in the image plane which have similar properties are used to define a boundary or edge. In order to 
accomplish this, code values from fiowblock 69 are reexamined at fiowblock 70 to determine whether the 
pixel code under test has a bright code neighbor as set forth in conventional eight-connectedness criteria. 
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All label codes which meet this criteria, i.e., are determined to be connected, are assigned common label 
codes at flowblock 72, and referred to herein as "blobs". These blobbed label codes are then examined at 
a flowblock 74 to determine whether there are any closely spaced blobs having different label codes. If it is 
determined at flowblock 76 that two blobs are closer than about one quarter of an inch, these closely 
spaced blobs are assigned common label codes at flowblock 78. 

Further processing involves establishing maximum and minimum blob sizes at flowblock 80. That is, it 
is determined that blobs having pixel sizes less than about 80 pixels are not large enough to represent 
edges; and if greater than about 4,000 pixels, are too large to represent label edges (most likely 
representing spurious shadows). Thus, at decision bloc, 82, if it is determined that a blob is above the 
maximum blob size (blobmax) or under the minimum blob size (blobmin), that blob is eliminated from 
further consideration. This reduces the number of blobs down to a range between about five and about 
-thirty. 

A blob which is within the aforementioned parameters is further processed at flowblock 84 to determine 
its orientation along its major axis. Orientation of each blob is determined in a conventional manner by 
calculating the eigenvectors of the second-moment matrix of the blob. 

Once the orientation of the blob is determined, then the extreme left pixel position and extreme right 
pixel position of each blob is identified at block 86. This in effect determines the left and right sides of the 
outer perimeter of a quadruped which represents the label/aperture. Further merging of the blobs is 
accomplished at flowblock 88 by merging those blobs which have extreme left or right side pixels within 
about one quarter of an inch of each other to further reduce the remaining blob count. With regard to the 
merging of the blobs utilizing the extreme points, the blobs are first processed to determine their center of 
mass, their extreme points and their rough orientation, i.e., the slope of the dominant eigenvector of the 
second-moment matrix. In the process of merging, their masses are added, their extreme points are 
modified, and their orientation is recomputed as a weighted average. 

The remaining processing steps involve defining pairs of remaining blobs which may represent possible 
left and right edges of the label/aperture, and then selecting the blob pair which is most likely to represent 
the label/aperture sides. More specifically, at flowblock 90. a determination is made whether two or more 
blobs are parallel to each other. If this test is satisfied, then the blob pair is considered a candidate left and 
right edge. Further reduction in the number of candidate blob combinations is accomplished by eliminating 
those parallel blob combinations that are too close or too far apart. That is, those blob pairs that are closer 
than about one half inch or further apart than about four inches and which therefore do not fall within the 
likely distance parameters between left and right edges of a label/aperture, are eliminated from further 
consideration at flowblock 92. 

For the purpose of the present invention, parallel blobs are defined to be those which are parallel to 
each other within a tolerance of about plus or minus 30° so as to include those apertures having rounded 
edge corners. Also, to insure that the quadruped determined by two parallel blobs is rectangular, either the 
corresponding tops or bottoms of the blobs are required to be no more than 25 lines (1") apart. 

From the remaining parallel blob combinations, the most probable combination which represents the left 
and right edges of the label are selected. Typically, this is accomplished by comparing each of these 
combinations to a preselected criteria for likely location, size and orientation of a label on a mailpiece. For 
example, a true label/aperture is probably near the center of the mailpiece and most probably aligned with 
the edges of the mailpiece. The blob combination which most closely corresponds to these sets of criteria 
is selected as being representative of the left and right edges of the label/aperture at flowblock 94. 

The location of the label/aperture on the mailpiece is then obtained by outputting at flowblock 96 the 
line and pixel counts from memory which correspond to the selected left and right edge blobs. 

Attached hereto as Appendix A is a detailed listing of the program set forth in flowchart form in Figs 8 
and 10. 
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Appendix A 



program labol^procdss 
implicit none 

byte bdata<2048*556> 
byte bout<1024,256) 
• ouivalenceCbdata/bo.ut) 
integer*2 idata ( 2048 ,25 6 > 
byte buffer(S192) 
integer*2 ierr 

integer mmphys*i/-j/k,i1,,j1'k1,threshold,ncolors/ 

1 ik^jk^color 

logical 5ttmap/h«ad»r.flcg 

integer nkaot/ulx/uly/imin/i.'nax 

real list(7^64) 

integer k?ptC5,64) 

common /window/ buffer 

if<getmap())then 

call oP9par«..Ti5D( , 3disk1;C5old.usps3orocess i lo') 
else 

call exit 
end i f 

call get.intC thresholds 'enter binarization threshold*) 
call get.ttfjo^intCidiin/imax/'entsr blob size thresholds*// 
1 ' (:iiin and rax)') 

call get.logiealCheader.f lao, # do images on taps have headers?* 

call ini(500) 
call selres(t) 
do 10 i=C/255 

call cmaoCi/i/i/i) 
continue 
call setcol(O) 
call movpl ( 1 0 24, C ) 
call movp2(1279,1C23) 
call ffill 
call setcol(255) 
call TtovpKD/0) 
call 'novp2(1C2!^1023) 
call ffill 
call senof 

uiriteC*,*) 'reading first file* 

call f iie.f rom_Taoe(bdat?,hesder_f 1 ac) 

mmphys = 4Q°0 
do 1 i=1*25o/4 

callset.Ti.nrCtnmpnys/'ierr) 
.call i4booke<buffer,bdata(1,i),2C4?) 

rtimphys = mmo h y s + 3 1 0 2 
continue 

call mo vp1 C0/0 ) 
call movp2(l023*255) 
do 20 i=1*256 
k = 1 

do 201 j=1/1024 
boutCj/i) * bdata(kzi) 
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k = k + 2 
Z G 1 continue 
;3 continue 

call wrbyteCbout, 1024,256) 

»rite(*/*) 'reading second file' 

call file.fron.tap^Cbdats/header.f lag) 

do 2 i*1, 256/4 

call setmmr (mmphys/i err ) 
call i4bpoke ( buffer, bdata(1/i)/ 2043) 
mmphys s mmphys+3192 
2 continue 

call *ovp1 (0/256) 
call movp2 (1 023/51 1 ) 
do 21 i=1,256 
k = 1 

do 210 j=1,1023 
boutCj/i) = bd?ta(k,i) 
k = k + 2 
210 continue 
2 1 continue 

call wrbyte (bout, 1 024, 256 ) 

writeC*,*) 'starting process' 
call strtmm(0/ierr) 
eall waitmm(ierr) 

mmphys - 4096 
do 3 i=1, 256/4 

call S3t.*ntnrCmmphys/ierr) 

call i4bpeek(buffer,bdrta(1,i),2C4' 3 . ) 

mmphys = mffl phy'3 + 3 T9 2 
3 continue 

call closm-uCierr) 

do 24 i*1,256 

do 241 j=1/2C45 
idataCj/i) = z e x t < bd a t a ( j / i ) ) 
241 continue 
24 continue 

call tiovpI C0/51 2) 
call *novp2C1C23/ 767) 
do 23 i=1/256 
k = 1 

do 230 j=1/1024 
bout(j/i) - bdataCk/i) 
k s k+2 
230 continue 
23 continue 

call «rbyte (bout/ 1 024/ 256) 



uiriteC*/*) 'blob encoding* 

call blobs(idata/2043/ 256/ threshold, ncolorO • 
iurxte(*,*) 'number of blobs found was : ' / nco 1 or 

iurite(*,*) 'pruning blobs' 

call 3lob.prune(idat3,ncolor 3 /i-nxn,iTiax,nkeDt) 
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uirit9(*/*) /number of blobs k?pt: '/nkept 



70 



75 



20 



25 



30 



35 



40 



45 



50 



jriteC*/*) 'analyzing pffirjinin; blobs' 
call blob.statsCkept/list/nk^Dt/idata) 



00 5 i=1/nkept-t 
do 50 j«i+1/nk3pt 

if CabsCkept C2ri>< 

1 absCk«ot(1, 



[merge close blobs 



'kBOt{4/j)) .It. 10 .and. 
i)-kept (3/ j) ) .It. 25>tnen 



Imerge i, j 



keptd/i) = koptCt/j) 
keat<2ri) = keot(2,j> 
kept<3/j) = k3ot(3xi) 
kept(4,j> - kept<4,i) 

list (7, i) = <list(1,i)*listC7,i> + listC1o)*list<7,j))/ 
Clist(1*i)+listn*j)) 
list <7, i) 

list (1 ,i)*list (1/ j) 
list (1/i) 



list<7, j) 
list C1,i> 
listd , j) 
go to 50 

else if Cabs(keot(1/j)-kcDt(3/i)) .It. 25 .end. 

cbs(keot(2/ j)-kect(4,i) ) .It. 10>then imerge 



1 



k«pt(1/j) = kept ( 1 , i ) 
keptC2/j) - kept(2^i) 
kept<3#i) = kept(3/>j> 
kept(4,i) = keptC4,j) 

list(7,i) = ClistC1^i)*listC7^i>+listC1^j)«list(7^j))/ 
(list (1,i)+listC1,j)) 
list C7, i) 

list<1,i)+list(1, j> 
1 i s t ( 1 , i ) 



list (7, j) 
list CWi) 
listd 0 j> 
go to 50 
end if 
continue 
continue 

do 51 i=1,nkept-1 !test for parallel, not too 

do :>2 j=i+1,nk*pt !close or far aoart 

if (abs<list<7, i)-list(7, j) ) .gt. 1,0)than !not parallel 

go to 52 

else if Cabs (kept (1 , i ) -kept ( 1 ,jl ) .gt. CQ2 .or. 

abs(k3ptC3/i)-kept(3,J)) .gt. 400)th«n. !too far ?csrt/ ignore 
go to 52 

else if CabsUept(1,i)-k*pt(1,j)> .it. 125 .or. 

abs (k3pt(3/i)-keot<3/ j)) .It. 125>th«n ! too close/ ionore 
go tc 52 

else if (absCkept <2xi)-keot<2/j)) .gt. 50 .or. 

absCkeot(4,i)-k*ot C4, j)) .gt. 50)then inot aligned 
go to 5 2 

•Is* 'just ri-ht 

ifCkeot(5,i) .ea. 0 .ana. k-?pt(5*j) .ea. Oitnen 

keot(5#i) * j 'first osrallel line 

kept<5/j) = i 

else 

if(keet<5,i) .eq. 0)then 

k = keptCS/j) 
a 1 se 

k = kept (5/i) 
end if 

i1 * abs (list(2/i)-1024) 
j1 = abs<listC2/ j)-1C24) 



1 



1 
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70 



75 



20 



25 



30 



35 



40 



45 



k1. = absdist (2,k>-1G24) 
ik = abs(list(2/i)-list(2/k)) 
jk = absClist tl, j)-list(2,k) ) 
if(jk .It. 12S)then lattach 
if (list (1 list(1,k))th«n 



i to the larger blob 



keptCS^i) : 

k«ot(5*j) ' 

k«pt(5*k> • 

else 

kept(5*i) ! 

keptC5/j> s 

kept(5<rk) : 

end if 
else if(ik .It. 



if (list C1 


✓ i> 


. g e • 


kept(5* 


i) = 


i 


kept(5^ 


j) = 


i 


k»pt(5* 


k) = 


C 


el s 9 






kept(5* 


i) = 


C 


k 3 pt(5. 


j) = 


k 


kept (5/ 


k) = 


j 



j 

i 

C 

k 
0 
i 



125)then lattach 
list (1,k) ) then 



j to the larger blob 



50 



end 
end if 
continue 
continue 



end if 
else 
ifCil .It. 
if(J1 .It. 
kept C5,i> 
kept (5*j) 
keot(S^k) 
else 
kept(5*i) 
kept (5^ j) 
kept(5*k> 
end if 
else if ( jl 
ifCil .It. 
keptCS^i) 
kept ( 5* j) 
keot(S^k) 
else 
k*ptC5/>i) 
kept C5, j) 
keo t(5^k) 
end if 
else if(k1 
if(il .It. 
keot (5*i) 
keDt (5, j) 
keptC5*k) 
else 
keotCSri) 
keptCS, j) 
koptCSxk) 
end if 
end if 
end if 
if 



J1 



and . 

k1 ) then 
= j 
= i 
= 0 

= k 
= 0 
- i 



.It. kt , 
k1 >t Hen 

- j 
= i 
= 0 

= 0 
= k 
= j 

•It. i1 - 
j 1 ) then 
= k 
= 0 

- i 

* 0 
= k 
= j 



i1 .It, 



! attach 
k1 ) then 



2 most central blobs 
! i is is central 



j is next 



and. j 1 



.It. iDthenfj 
! i is next 



is central 



and. k1 .It. j1)then!k is central 
! i is next 
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color a C 

co *6 i = 1/nk«ot-1 'outline the label 

5 ifCkept(Szi) .ea. 0)go to 6 iparallel to nothing 

j * kept<5,i> 

call polys 

ulx ' kept(t/i)/2 

uly = ktptC2*i)+767 

call poly v ( ul x/o ly ) 
w ulx s kept<1,J)/2 

uly = k«otC2/ j)+767 

call poly v Cul x/ u ly ) 

ulx = keptC3,j)/2 

uly = kopt(4, j>+767 

call polyv (ulxsuly ) 

ulx » kept<3/i)/2 

uly = keptU,i) + 767 

call poly v (ulx^u ly > 

call polyc 

call setcol (color ) 

call polyf 

color s color+1 
20 continue 

close<unit=2) 

call fr an d(1C24, 256, C^25c, 0,765) 

25 call fini 
call exit 

end 

subroutine Dlob.pruneCideta/ncol/irin/^ax/nkjot) 
30 inolicit none 

integer ncol/flin/ffsx/nkept 
integer*2 ida ta ( 204 3/ 25 t ) 

integer 1 u t ( 0 : 3 2 7 6 7 ) , i j , k 

35 

steo 1: histogram the blob sizes 

do isQ/ncol 

lutCi) = 0 
end do 

40 do i = 1/256 

do j=1,2043 
k = idata(j/i> 
lut(k) * lut(k)+1 
and do 
end oo 

45 

step 2: if lutCj) is not within min-max, set to C, else reassign color 
nkept * 0 
lut(C) = 0 
do i=1/ncol 

if(lutCi) .It. irin .or. lutCi) .gt. max)then 
50 lut(i) = 0 



55 
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• is* 

nkoot = nkeot+1 
5 lutCi) = nkept 

• nd if 
and do 

ste© 3: rtmap ideta through lut 

do i*1*256 
10 do J=1,2043 

idataCj,i) * lu t ( id* t a < j/ i ) ) 
and do 
«nd do 



75 



30 



40 



return 
end 



subroutine f ile.f rom.tape (buf f sp/header^f l?g J 

INCLUDE * ( SIOCSF) ' 
I*JCLUD£ * CSSS3EF) * 

20 S*?S buffer C204S/256) 

INTEGER*2 HSAO=R(256) 
logical header. flag 

PARAMETER 3UFF=R_LENGTH = 16354/ INPUT FLAG = 1 
INTEGER** INPUT. POINTER 

25 INTSGER*4 SYSSASSIGN/SYSSOIO 

INTEGER*4 IN PUT.CIR. STATUS 

INT EG ER * 2 INPUT/ I K PUT .S T A TUS C 4 ) 

Assign channels to the input tap© drive 

INPUT. OIR. STATUS = SYSSiSSIGN C'MSAO:*, INPUT//) 



IF (INPUT. OIR. STATUS .NE. SSS. NORMAL) THEN 
TYP£ ZO/ I NPUT^OI R. STATUS 
^ 3 FORMAT C* ERROR! "t'nable to assign channel to input tape drive'/ 

1 " error- code =*/ Z9.4) 

35 GO TO 990 

END IF 

Read the first record from the input tape drive (image header) 



if (header. flag) then 

INPUT. DIR. STATUS = SYSSCIO ( X v a 1 ( INPUT. Pi A G ) 

1 %val (INPUT) / 

2 a 4vaiClOS.R = 4CLaLK)/ 

3 INPUT. STATUS/// 
* rieAOEF/ 

5 ■<val(eUr c ER. LENGTH)/ 

6 ///) 

45 CALL SYSJWAITFR (Xval(lN PUT. FLAG) ) 

end if 

oo 1 input. pointers'! / 236 



50 
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INPUT. DIR.STATUS - SYSSGIO < % v al ( I N »UT.PL A G ) 

1 ZvaKIMPUT)/ 

2 %val<I0T RSADLSLK ) / 

3 INPUT. STATUS//* 

4 8UFFER(1/inout_Dointer>/ 

5 XvalCEUFFeR. LENGTH) / 

6 ///> 
CALL SYSSWAITFR C Xva 1 ( INPUT. FLAG ) ) 



continue 



READ THE EOF 



INPUT.DIR. STATUS * SYSSQIO ( Xval ( ISPUT.FLAG) / 

1 %val(INPUT)/ 

2 %val(I0$_REA0L3LK)/ 

3 INPUT.STATUS/// 
A HEADER* 

5 %val(5UFF5R. LENGTH)/ 

6 ,// ) 
CALL SYS2WAITFR (%val(INPUT FLAG) ) 



CALL SYSSOASSGNCINPUT) 



return 

ENO 
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subroutine bloa.stats(kect/li;t/ncolor/data) 
implicit none 



ccccccccccccccccccccccccccccccccceccccccccecceccccesccceecccccccccccc 

subroutine to compute vital statistics of all interesting blobs 
in the processed images up to 64 all told 



integer ncolor 
integer kep t ( 5 * nc ol or ) 
real 1 ist C 7/ nco Icr ) 

real stats <6/64)/trace*det*delt3la>n 
logical first<60 
mteger*2 da ta < 2C48 / 2 5 6 ) 
integer i/j/k 

co 10 i=1/ncolor 

firstCi) s • t rua . 
do 10 j=1#6 

stats(j^i) = C 
c on t in ua 



do 1 i=1*256 
do 2 j-1/2043 
k * dat a < i ) 

if(k .gt. G .and. k «le. ncolor)then 

statsd/k) = stats (1 /k) +1 !* elements 

statsC2*k> = stats(2/k)+j !su.i x 

statsC3^k) = stats(3*k)+i !sun y 

stats(4,k) = stats C4/k ) + ! sum x*x 

stats(5/k) = stats(5*k)+i*i ! sum y*y 

s t a t s ( 6 / k ) *i * j !su<n x*y 



stats(6*k) 
kapt(3/k) = j 
keot(4,k> s i 
if (first Ck) )than 
k e p t C 1 ✓ k ) = j 
keptC2xk) = i 
first(k) = .false 
end if 
eno if 
c on t i nue 
continue 



G o 3 k * 1 ✓ ncolor 

iistC1*k) = stats(l^k) 

list<2/k) s ststs(2/k) /list (1 ,k) 

list(3^k> = stats(3*k)/listC1/k) 

list (4, k) = stats(4,k3/listC1/k)-iistC2'k)*list(2/k) 

list (5rk) = stats(5/k>/listC1/k)-list(3i-k)*list<3/k) 

list(6xk) = stats<6/k)/list(1/k)-list(2/k)*list(3^k) 

trace = ( 1 i s t C 4, k) + 1 i s t C 5 , k ) ) / 2 

det * list(4^k)*list<5/k)-listC6/k)*list<6/k) 

deltalam = sqrt ( trac © * t r ac e-de t ) 

ifCdeltalam .ac. 0) then 

list(7*k) = OcO 
else 

list<7'k) = list (6/k) /del talam 
end if 



continue 

return 
end 
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PROGRAM PROC 

- INTEGER CATA1(1024,256),CATA2(1024,256) 
REAL C DAT A 1 C409 6/ 32 ) / COAT A 2 (409 6/ 32 ) 
REAL 0UM1RC1) /DUMId ) / DUM2R ( 1 > ,0UM2l C 1 ) 
REAL 0UM1 (1/1 ),DUMP1 C 1, 1 ) ,0UH2 C 1 / 1 ) , CUMD2 (1 , 1 ) 
REAL CSPEC1C1,1),CSPEC2(1,1),CEXP<1 ),0UMWK(1 ) 
INTEGER I0UM1(1),IDUM2(1) 

REAL EXP (4096) /A1 <3 2 ) / A 2 C 3 2 ) , FWOR K ( 409 6 ) 
INTEGER I/J 

REAL DUMA1 (1 ) ,0UMA2 (1 ) 

COMMON /I01/ 0ATA1 

COMMON /I02/ OAT A 2 

COMMON /L0CAL1/ COAT A 1 

COMMON /L0CAL2/ CO AT A 2 

COMMON /UCRK/ SXP,FW0RK,A1 /A2/I/ J 

CALL IOENT ( 0UM1 R,C0ATA1C1,1), 2^65536.0) 

CALL I0ENT(0UM1I,CDATA1 C1,1), 1,2/65536.0) 

CALL I0ENT(DUM2R/C0ATA2(1/1 )/ 2/65536.0) 

CALL IDENT(0UM2I/CDATA2<1/1)/1/2/65536.0) 

CALL I0ENT(CSPEC1/C OA TA 1(1/1), 409 6/3 2/ 2/2043) 

CALL ID ENTCC SPEC 2/C0 ATA2 ( 1 /1 )/ 4096/ 3 2/2,2043) 

CALL I0ENTCCEXP/EXPC1 ), 2/2043) 

CALL I0ENT<DUM1/CD4TA1C1,1), 4096, 32, 1,34) 

CALL IOENT C0UMP1,CDATA1C1,1), 40 64, 40^6, 32, 1,32) 

CALL IDSNT<DUM2/CDATA2C1,1 ) / 40 9 6/ 3 2 , 1 , 3 4 ) 

CALL IOENT C DUMP 2 / C D A T A 2 ( 1 ,1 ) , 4064, 4096, 32, 1,32) 

CALL IDENT CDUMWK/FWORK (1 ) ,1 ,40 96) 

CALL IDENT(0UMA1,A1 (1),1,3'2> 

CALL IDENTC0UMA2/ A2(1 ) /1 / 32) 

CALL GCXT4CCEXP) 

CO 1 1=1/256,32 

CALL ICENTCICUM1,DATA1 (1,1), 1,32763.0) 

CALL IOENTdOUM 2, DATA2< 1/ 1), 1,32763.0)* 

CALL VCLR(OUMII) 

CALL VCLR(DUM2I) 

CALL VFLSCOUM1R,1.0,IDUM1,1.0) 

CALL VPLS(0UM2R,1 . 0 , I 0 UM 2 , 1 . C ) 

CALL VLNC0UM1 R/1 .0/0UM1 R) 
CALL VLNCDUM2R/1 .0/0UM2R) 

CALL FCFCL(CS?EC1,CS?EC1 ,Cl)M«K,C = XP) 
CALL FCFCL(CS?EC2,CS?EC2,OU w WK/CEXP) 

CALL MSMA1 (QUM1 ,C.C,0UM1 /CO) 
CALL MSMA1 (0UMP1,C.0/0UWP1 ,0.C) 
CALL MSMA1 (0UV2/C.0,0UM2,0.0) 
CALL MSMA1 (OUMP2,C.0,OUMP2/O.C) 

CALL FCICL(CSPSC1/CSP=C1/0U*WK/C5XP) 
CALL FCICL (CSP5C2/CSPEC2/CUMWK ,CEX?) 
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CALL VS3 CDUM1 S^DUMiR) 

CALL VA(CUM1R) 

"CALL MCMAX(DUMA1/DU1A2*CSP£C1) 

CALL VRCP(DUMA1,-2 5 5.0*0UMA1,0.,001> 

00 2 J=1,32 

CALL VSMA1 < CO AT A 1 (1#J).?A1 ( J ) , C 0 AT A 1 ( 1 , J) , 25 5 . 0, 2C 48 / 1, 2 > 
CONTINUE 

CALL VFxe<I0UMl,1 . 0, DUM1 R, 0 . 0 , 2 5 5 . 0 ) 

CONTINUE 

PAUSE 
END 



25 
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subroutine SLOB $ < a/NX^N Y/ ithr/ icols ) 
5 ********** •**************************«*#****•******** ******* 

*blobsx«for modified by J. MacAuslan 5/25/84 

from *blobs3* 

mod, 1/15/35 (j.m.) to -use * BKG02 * / and init. only 1st "ftm" tltntnts 
of *lut*. 



Identifies all connected regions in a/ and colour codes 
70 them, regions having value > ithr in a/ are reset 

to 0* regions < itnr are tested to 
assign colour* 1/2/... 



75 



20 



arguaen ts 

a input array integer*2 

NX/NY no. "rows"/ "cols" of a 

ithr threshold for black ridges 

icols number of separate region? or colours 



'lutC'i'*)' is always .LE. "i" (for all "i" in 0,.'FULL*> 
.__ parts of this routine m?ke use of this restriction. 
Also/ 'lutdutC'i"))' * *lut("i"> # C"i" in C.'FUIL*) — i.e./ each 
output pixal is to be mrpped in a SINGLE oass thru *lut* into the color 
giv»n (as well as is known as each oixel is processed). 



IMPORTANT; 
certain 



it is to be 



imolicit none 

integer FULL/ SOCCER/ SKG0 

INTEGER*? 3KGD2 ! Just to avoia some needless type*con versions 

parameter <FULL=32767/ S030ER s 0/3KG0 = 0/ 3* G02 = 2KG0) 

Arr - Map_Int_Tbl.Int2CI»2C'N # ): Out; I«2 ( 'N ' ) ;n = L:N; INT (0: *K # >;k=LEN> 
integer NX/NY/lutC0:r"ULL)/lut2<3:?ULL) 
integer*2 a<NX/NY) 

integer i/j/l 
integer c*d 

integar icols/ithp/ncols 
procedure 

initialize counters, 'ncols* is the current region nu^b?r to be filled 
in / tne number of colors used so far). 

initialize lut (max. no. of feetures is given by checkerboard pattern/ 
for aihich no. of f»atur«s is * 1 *N X * N Y / 2 ' ; but limit to 'F'JLL* = length 
of *lut* array/ of course): 
do i=0*Min<FULL/1+NX*NY/2) 
1 u t C i ) » i- 

end do 

• >> 'lutC'i")' ,LE. "i" Call "i" in 0..'?L*LL*) <<. 
ncols»0 

IF(3HG0.UT. PULL/2) ncois = 3 KGC 

fill in neighborhood (*b # ) with eclors/ a different color for each 
region, fiorder pixels/ ?nd thos? that are >ithr in the input <*a") 
array/ are given the value '3KG92* / and do not contribute to 
the count of regions. 



orocess first column of a/ seoarate process for first element 
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ncols - C 

it(a<1*1) .gt. ithrMhen 
a<1/1) = BKG02 

• Ise 

ncols * ncois+1 
a<1*1) = ncols 
end if 

do i»2*nx !do rest of column 

if(a(i,1> .gt. ithr)then 'not in s component 

a(i*1) * 3KG02 

else if(a(i-1,1) .ne. B KGD2 ) than !fill with san« color 

aCixl ) = a(i-1/1) 

{assign en color 

ncols * ncols+1 
a<i/1) = ncols 
end if 

• nd do 

do 1 CQQ j=2,NY *do rest of columns 

ast first •lament in column versus its left h?nd neighbor 

if(a(1,j) .gt. ithr)then !not in a component 

aC1,j) s 9KGG2 

else if(a(1*j-1) .ne. 9KG02)then .'fill with same color 

a(1,j> « aM, j-1 ) 
tlse if(a(2*j-1> .ne. 3KG02)then ifill with same color 

aC1/j> = a(2/j-1) 

alsa iassign a new color 

Ir (ncols. 5C. FULL) THEN 

CALL SdZLUTClut^FULL^a, ( j-1 ) *HX, nco 1 s , lu t 2 ) 

ENO IF 

ncols = ncols+1 
a (i/ j ) =ncols 
end if 

do 1001 i=2,NX-1 i now d0 rffSt of =olumn 

if (aCi, j) .gt.ithr) then 'set threshold *cr ridces 

a(i,j)=3K302 loart o* the edge 

50 to 10C1 

•lse if Ca<i-1,j).ne.3KGC2> then ifill with same color ss oixel 

! above 

a(i/j)=a(i-1,j) 

if( a(i, j-1 ) .ne.£KGC2) then 'modify colors if necessary 

!to make each region have 
!only one color 
if(a(i#j}.ne««Ci/j*1)> then 

c=min(lut(aCi,j)),lut(a(i,j-1))) 

ds-nex <lut (a (i/ j) ) /lut(a(i,j-1))) 

lut(d)*c ! 'lut(d)* is reduced here. 

do l=C/ncols 

if <lut(l) .eo.d> lut(l)=c 

end do 

end if 

end if 

if( a(i-1, j-1 ) .ne.SKGC2) then 

if (a (i* j) .ne . a ( i-1 , j-1 ) ) then 
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c = .T»in(lut(3(i/j)) / LutCc<i-1,j-', ))) 
a = max<lut<a(i,j)),lut(a<i-1o-1)>) 
lut<d)=c * 'l u t(d>* is reducad here, 

do l=c*ncols 

5 if ClutCD.aq.d) lut(l)-c 

end do 

end if 

end if 

if( a(i*1/j-1 > .ne.3KG02) then 

if (a (i/ j) .ne .a (i*1 , j-1 ) ) then 
10 c**in<lut (a(i*j> ) ,lut <a€i+1, j-1 > ) ) 

d*inax <lut Ca Ci* j) )#lut CaCi + 1*J-1 ) ) ) 
lut(d)=c ! Mut(d>* is reduced here, 

oo lsc/ncols 

if (lutCl) .eo.d) lut(l)=c 

,c and do 

75 end if 

end if 

SO to 1001 

«lse if CaCi, j-1).nt.8KGC2> then !fill with sa*e color as 

20 . m icrevious oixel to left 

ifC aCi+1, j-1) .ne.3KGC2) th*n 

if CaCi., j) .ne.a<i+1, j-1 ) ) then 

c = min(lutCa(ixj))/.lut<a(i+1,j-l))> 
a=maxClut(a<i^j)),lut(a(i+1,j-1))) 
25 lut(d)«c i 'lut(d)' is reduced hero. 

do l=C/ncols 

if (lut(l).eq.d) lut(l)»c 

end do 

end if 

end i f 

30 i f < a Ci-1 , j-1 ) .ne .3KGD2) then 

if CaCi/ j> ,nQ.8(i-1/ j-1 ) ) then 

c = min(lut(aCi/j>),lutCaCi-1,j-m) 
d=max(lutCa<i/-j)),lut(aCi-1/j-1))> 
lut(d)=c ! *lut<d)* is reduced hare, 

do l=C/ncols 

35 if (lut(l).eq.d) lutCl)=c 

end do 

end if 

end if 

go to 1001 

40 else if <a(i-1,j-1).n*.5KG02> then 'fill with same color as 

iprevious pixel to left 

a(i/j)=a(i-1/j-1 ) 

ifC a(i*1 , j-1 ) .ne«B!CGC2) then 

if(a(i/j).ne.a(i+1/j-1))then 
45 c=min<lut(aCi^j)),lut(a(i+1,j-l))> 

a=maxClot(a(i/j)),lut(aCi+1/j-1))) 
lut(d)=c i 'lut(d)' is reduced here, 

do l=C/ncols 

ifClut(l).eq.d) lut (l)=c 

end do 

50 * nd if 

end if 

50 to 1001 
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else ifCiUH/j-n .ne. B«CC<nth«n 
aCi,j) = a(i+1/j-1) 
50 to 10C1 

else lapparently a new region/ so fill uiith new color 
IFCncols.SQ.FULL) THSN 

CALL SozLUTC lu t/FULL*** ( j-1 >*NX+i-1*neols,lut2) 
£N0 IF 



neols » ncols+-1 
« C i* j) =ncols 



70 

end if 

I0O1 continue 

75 * now do last element in column 

ifCa(NX,j> .gt. ithr)then 
a(NX,j) = 3KSD2 
go to 1CC0 

else if (a C NX-1 * j ) .ni, 3KGC2)then !pixel above 

a(NX/j) = a(KX-1/j> 
20 ifCa<NX^j-1) .ne. SKGD2) tHjn 

if (a (NX/ j ) .ne . a<NX, j-1 ) ) then 

c«minClut<a(NX*J>)>lut<a(NX*j-1)>> 
d=maxClut(a<NXrj>),lut<a(NX,j-1))> 
lut(d)=c ! *lut(d>* is reduced hard, 

do l=c/ncols 

ifClutCD.ea.d) lut(l)=c 

25 end do 

and if 

• nd if 

if (aCNX-W j-1 ) one. 8*GD2>th*n 

if<a.(NX#j).ne.a(NX-1#j-1)> then 

c=min<lut<aCNX*J)>,lutCa(NX-1,j-1>)> 
d=smax<lutCa<NX,j)>,lut<a(NX-1/j-1)n 
lut(d)=c ! *lut(d>* is r»duc»d here, 

do l=c/ncol s 

if Clut(l).eq.d) lut(l)=c 

ana do 

and if 

end if 

35 50 to 10C0 

else if(a<NX*j-1) .ne. 5*002) then loixei to left 

a<NX,j) = a<NX,j-1> 
if CaCNX-1, j-1 ) e r.e. 3KG02)then 

if(3(NX,j).ne.a<NX-1,j-1>) then 

c = TTinClut(aCNX/j))/lutCa<MX-1^j-1))) 
dsm»x(lutCaCNX*j)>*lut(a<NX-1,j-n)) 
4 ° lut(d)=c ! *lut(d)* is reduced- here. 

d o l = c /ncels 

ifClutCD.aq.d) lut <l>*c 

end do 

end if 

end if 

go to 10C0 

5 «lse if (cCNX-1/ j-1 ) .ne. 3KG02)then !oixe.l to left and above 

aCNX/j) * a(NX-1/j-1) 
go to 10C0 

else ! neut color 
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.IP<ncols.50.FULl> TH5N 

CALL SozLUTClut*FULL*«#NX*j-t,ncol*,lut2> 
END IF 

ncols a ncols+1 
i(NX* J)»ncol$ 

• nd if 

TO 00 continue 

* Fix ud # lut' Cif n»c.)* -nap through *lut*: 
lutCBKGO) * aOROER 

CALL SqzLUT<iut*FULL/#'NX*NY/ncoi$/iut2) 

icols * ncols 

rtturn 



subroutine Xut f i x < LUT * NLUT 1 , lu t 2 / NLUT 2, nc t II s2 ) 
int»g«r LUT(C:NLUT1> 
integer lut2 ( 0 : NLUT2) 

20 * On input., 'LUT("i"? # .LE. M i"# for all "i" in C.'NLUTI*. 

ncells2 * -1 
do i»Q,NLUT1 

IF<LUT<i) ■ cQ. i) THEN i Guaranteed . T » L' ? * far *i* * 0. 

nc»lls2 » ncells2 +1 • >> ' ; '=0 *> *ncalls2' * 0 << 

lutZCi) » ncells2 • >> ... so *l u t2<05* * C << 

if Cncells2.*o;.NLUT2) GC TC 1^00 
5N0 IF 
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* >> 'ncells2 # in 0 'i* <<. 

• nd do 
RETURN 

: 00 grite(»,«> ch8p(9)/'No. ceils .G£. **NLUT2 
RETURN 

30 £N0 

SU3 ROUT IK £ So 2 LUT C lu t , LUT S I Z £, b , 3 L = nco 1 s , 1 ut 2 ) 
IMPLICIT NONE 
DECLARE: 
In: 

INTEGER LUTSIZE^BLEN J jyoe LEN 

In/Out : 

35 INTEGER lut(0:LUTSIZE>#lut2(0:LUTSX2E> ! Tyoe "COLOR" i5 tyoe 0..'LUTSIZ=* 

INTEGER** b<») « T yPf "COLOR" 

INTEGER ncols • Type NUM 

Local: 

INTEGER ncoisO * Tyoe NUM 

INTEGER i ! T ypt INDEX 

Routines: 

40 Arr. M*E>.TbI.Int (INT C 'N'5 : Out ; ( 0 . . ' K * ) ( *N * ) ; N*L EN; I NT < 0 : ' K * ) ; X al. EN ) 

Arr.M*D.int.Tbi.int2(i*2(*N*): out; a.. * k* : i * 2 < * n • ) ; m*l en; INT ( 0 : * K * ) ; K n =n ) 

LUTFix CNUrtCO: * L * ) ; L = LE n; NUrt t C; * N * ) : Ou t ; N*LS N; NUK) 

"SCUEEZe" L0QK-U? TA3LE/ SC T'riT S £ C UNO A NT COLORS ARE 0E-ASSIGN60, iNC US =0 
COLORS ARE CONSECUTIVE. 

45 
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C Note that only first 'ncols' colors are orocass»i* 



70 



75 



20 



VARIABLES : 
External: 

Requirements (on intry): 

*lutC"i")' in 0..'i* < => all values in C. • "LUTST ZS * ) 
*b* elements in C^LUTSIZc* 
'ncols" in 0..*LUTSI2E* 
Guarantees Con return): 

'ncols* .L£, initial Con-entry) velue 

'b* elements in 0. .'ncols*, and/ for all "i" in Q..'neols*/ 

there exists ?n element cf 'b* with value "i" 
'lutC'i")* = "i" <"i" in C.'LUTSIZr') 

LUTSIZE = size of look-uc t?bl*« 

lut - xnit. look-up table* -nacpin? *b* to connect comoonents oroaerly 

lutZ * te.no. look-up t*tl* to ?djust 'lut* oefor. naooing *b* 

b x array cf "colors'* Cto be naoosd to asti-tn connected coiroonents 

the same color) 

ncols - no. of "colors" us*d in 'b' ?rr?y (i.e., v?lu*s G..*nccls') 
Local : 

ncolsO » initial value of 'ncols* 
i = loop ('lut') index 

■H STOttT : 

author: Joel ^acauslan 
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3 000 



ncolsO = ncjls 

* >> 'ncolsO* in 0..*LUTSIZ?' <<, 

» Count no of co(rson«nts ("colors**): 

call lutfix(lut/ncolsOrlut2/LUT5IZ=#ncols) 

* >> 'ncols* in C. 'ncolsO* <<. 

* Adjust look-uo table: 

call arr.-fao.tbl.int (lut,lut/ncolsC + 1 *lut2,LUTSIZS) 

* >> For ''i" in C./ftcols'/ *iut("i")* = "i" <<. 

* Adjust *b* arrey correspondingly: 

call arp_fflaD_int_tbX_int2(b*b*5LSN*lut,LU7SIZE> 

CO 5C0C/ i » CxLUTSIZE 
lut(i) = i 



RETURN 
SNO 
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40 Claims 

1. Apparatus for generating signals which are representative of edges of an address element which is 
located adjacent to a substantially horizontal surface of a mailpiece, the address element including a first 
substantially horizontal surface as well as first and second substantially vertical side surfaces which are 
45 located between the first horizontal surface and the second horizontal surface so as to form the edges, the 
apparatus comprising: 

a. illumination means including 

1) first light means for generating a first illuminative output directed toward the address element in a first 
direction and at an acute angle to the horizontal surfaces of the address element and the mailpiece, and 
5Q 2) second light means for generating a second illuminative output directed toward the address element in a 
second direction and at an acute angle to the horizontal surfaces of the address element and the mailpiece, 
the first light means and the second light means being positioned so that the address element is located 
therebetween; 

b. detection means including 

55 1) first means for i) detecting light reflected from the address element generated by the first light means in 
a manner that light reflected from the horizontal surfaces generates a first signal having a first level, light 
reflected from the first side generates a second signal having a second level which is greater than the first 
level, and light reflected from the second side generates a third signal having a third level which is less than 
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the first level, and ii) for generating a first output of the first, second and third signals, and 
2) means for i) detecting light reflected from the address element generated by the second light means in a 
manner that light reflected from the horizontal surfaces generates a fourth signal having a fourth level, light 
reflected from the second side generates a fifth signal having a fifth level which is greater than the fourth 

s level, and light reflected from the first side generates a sixth signal having a sixth level which is less than 
the fourth level, and ii) for generating a second output of the fourth, fifth and sixth signals; and 

c. signal difference means including means for generating a difference between the levels of the 
second output and the first output in a manner that i) a difference between the first signal and the fourth 
signal generates a first difference signal which has a level which is lower than that of the first signal and the 

io fourth signal, ii) a difference between the third signal and the fifth signal generates a second difference 
signal which has a level that is greater than the first difference signal and which is representative of the 
location of the second edge, and iii) a difference between the second signal and the sixth signal generates 
a third difference signal which has a level that is greater than the first difference signal and which is 
representative of the location of the first edge. 

75 

2. The apparatus as set forth in claim 1 wherein the signal difference means includes means for 
generating a difference between the second output and the first output in a manner that i) a level difference 
between the first difference signal and the second difference signal is greater than a level difference 
between the fifth signal and the fourth signal, and ii) a level difference between the first difference level and 

20 the third difference level is greater than a level difference between the second signal and the first signal. 

3. The apparatus as set forth in claim 2 wherein: 

a. the first level and the fourth level are substantially equal; and 

b. the signal difference means includes means for generating the difference between the first level 
and the fourth level in a manner that the first difference signal has a level of substantially zero. 

25 

4. The apparatus as set forth in claim 2 wherein: 

a. the address is formed by the first horizontal surface and the first and second side surfaces which 
extend upward from the mailpiece horizontal surface; 

b. the illumination means includes means for operating the first light means and the second light 
30 means in a manner that the first illuminative output and the second illuminative output are not present at the 

same time; and 

c. the first light means and the second light means are positioned i) so that the first side surface 
faces the first light means in a manner that the first illuminative output illuminates the horizontal surfaces 
and the first side to generate the first and second signals, but the first illuminative output does not illuminate 

35 the second side in order to generate the third signal, and ii) so that the second side faces the second light 
means in a manner that the second illuminative output illuminates the horizontal surfaces and the second 
side to generate the fourth and fifth signal, but the second illuminative output does not illuminate the first 
side in order to generate the sixth signal. 

40 5. The apparatus as set forth in claim 3 wherein: 

a. the address element is formed by the first horizontal surface and the first and second side 
surfaces which extend down from the mailpiece horizontal surface; 

b. the illumination means includes means for operating the first light means and the second light 
means in a manner that the first illuminative output and the second illuminative output are not present at the 

45 same time; and 

c. the first light means and the second light means are positioned i) so that the second side faces the 
first light means in a manner that the first illuminative output illuminates the horizontal surfaces and the 
second side to generate the first and second signals, but the first illuminative output does not illuminate the 
first side in order to generate the third signal, and ii) so that the first side faces the second light means in a 

so manner that the second illuminative output illuminates the horizontal surfaces and the first side to generate 
the fourth and fifth signals, but the second illuminative output does not illuminate the second side in order 
to generate the sixth signal. 

6. A method of generating a signal which represents an edge of an address element, the method 
55 comprising the steps of: 

a. providing an address element which is located adjacent to a horizontal surface of a mailpiece and 
which has a horizontal surface as well as a vertical surface located between the mailpiece horizontal surface 
- .and the address element horizontal surface in a manner to form the edge; 

24 
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b. directing an illuminative output toward the mailpiece and address element at an acute anqle to the 
horizontal surfaces; 

c. detecting light reflected from the address element and mailpiece in a manner that light reflected 
from the mailpiece and address element horizontal surfaces generates first and second luminance signals of 
substantially equal levels, and light reflected from the vertical surface generates a third luminance signal 
having a level which is different than the levels of the first and second signals; and 

d. generating I) first and second output signals of substantially equal levels in response to the first 
and second luminance signals in a manner that the first and second output signals are associated with the 
ocations of the mailpiece and address element horizontal surfaces, and ii) a third output signal having a 
evel which is different than the levels of the first and second output signals, in response to the third 
luminance signal and which is associated with the location of the vertical surface between the mailpiece and 
address element horizontal surfaces. 

7. The method as set forth in claim 6 wherein: 

a. the acute angle is less than 45 ' ; and 

b. the third luminance signal has a level that is greater than the levels of the first and second signals. 

8. The method as set forth in claim 6 wherein the edge is formed by an intersection of the address 
element horizontal surface and the vertical surface which is characterized in that it upstands from the 
mailpiece horizontal surface. 

9. The method as set forth in claim 6 wherein the edge is formed by an intersection of the mailpiece 
horizontal surface and the vertical surface which is characterized in that it depends downward from the 
mailpiece horizontal surface to the address element horizontal surface. 
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€> The edges of address elements such as address 
labels and window apertures located on a mailpiece, 
^are detected by utilizing illumination from first and 
^second alternating "on" and "off" light sources 
which illuminate the address elements at an acute 
gangle. In the case of label detection, the edge clos- 
est to the on illuminating source generates a high 
contrast image, while the edge furthest from the 
£J°on" illuminating source is shadowed. In the case of 
TO illumination of an aperture, the opposite is true. That 
o is, the light reflected from the edge which is furthest 
from illuminating source is high contrast, while edge 
£L closest to the illuminating source has a lower con- 
"Jtrast. When the images generated due to edge illu- 
mination by the left and right light sources are sub- 
tracted from each other, the edges are further en- 



hanced due to the fact that the remaining portions of 
the images cancel each other out. 
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